Design Lessons From Binary Fission: A Crowd Sourced Game for Precondition Discovery
نویسندگان
چکیده
ion of formal verification One of the strengths of Binary Fission is how well it abstracts away the messy details of formal software verification and presents it as a simple sorting problem. This allows for Binary Fission to represent a wide range of data types and predicates, and get input data from a wide variety of programs. This also keeps Binary Fission accessible to a wide audience. However, this abstraction also turned players off to playing the game. A subset of players wanted to know more about the mathematical underpinnings behind the quarks, filters and sorting, and felt frustrated by the lack of information they could get about any particular problem. Finding the correct balance between expressibility and flexibility is a core problem in crowd sourced formal verification games. In addition, it becamemore difficult to leverage the innate human skill of spacial intuition at such a high level of abstraction.
منابع مشابه
Lessons from Fraxinus, a crowd-sourced citizen science game in genomics
In 2013, in response to an epidemic of ash dieback disease in England the previous year, we launched a Facebook-based game called Fraxinus to enable non-scientists to contribute to genomics studies of the pathogen that causes the disease and the ash trees that are devastated by it. Over a period of 51 weeks players were able to match computational alignments of genetic sequences in 78% of cases...
متن کاملGhost Map: Proving Software Correctness using Games
A large amount of intellectual effort is expended every day in the play of on-line games. It would be extremely valuable if one could create a system to harness this intellectual effort for practical purposes. In this paper, we discuss a new crowd-sourced, on-line game, called Ghost Map that presents players with arcade-style puzzles to solve. The puzzles in Ghost Map are generated from a forma...
متن کاملPair Me Up: A Web Framework for Crowd-Sourced Spoken Dialogue Collection
We describe and analyze a new web-based spoken dialogue data collection framework. The framework enables the capture of conversational speech from two remote users who converse with each other and play a dialogue game entirely through their web browsers. We report on the substantial improvements in the speed and cost of data capture we have observed with this crowd-sourced paradigm. We also ana...
متن کاملReducing the Cost of Dialogue System Training and Evaluation with Online, Crowd-Sourced Dialogue Data Collection
This paper presents and analyzes an approach to crowd-sourced spoken dialogue data collection. Our approach enables low cost collection of browser-based spoken dialogue interactions between two remote human participants (human-human condition) as well as one remote human participant and an automated dialogue system (human-agent condition). We present a case study in which 200 remote participant...
متن کاملCSSWare: A Middleware for Scalable Mobile Crowd-Sourced Services
The growing ubiquity of a variety of personal connected computational devices – each with a number of sensors – has created the opportunity for a wide range of crowd-sourced services. A busy professional could find a restaurant to go to for a quick lunch based on information available from smartphones of other people already there. Sensors on smartphones could detect whether their owners are ha...
متن کامل